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A.  Statement  of  problem  studied. 

The  filtering  problem  considered  here  is  based  on  the  following  signal  observation  model: 


dx{t)  =  f[x{t))dt  +  g{^x{t))dv{t)  a:(0)  =  xq 

dy(t)  =  h[x{t))dt  +  duj(t)  y{0)  —  0 


in  which  x,  v,  y  and  u’.  are,  respectively,  R",  Rp,  R""  and  R"*  valued  processes,  and  v 
and  w  have  components  which  are  independent,  standard  Brownian  process.  We  further 
assume  that  n  =  p,  h  are  C°°  smooth,  and  that  g  is  an  orthogonal  matrix.  We  will  refer 
to  x{t)  as  the  state  of  the  system  at  time  t  and  y{t)  as  the  observation  at  time  t. 

Let  p(t,  x)  denote  the  conditional  probability  density  of  the  state  given  the  observation 
{2/(5);  0  <  s  <t}.  It  is  well-known  that  p{t,x)  is  given  by  normalizing  a  function,  cr(t, x), 
which  satisfies  the  following  Duncan- Mortensen-Zakai  equation: 

m 

da(t,x)  =  Locr{t,x)dt +  ^^LiCr{t,x)dy{t),CT{0.x)  =  (Tq  (2) 

i=l 


where 


t=l  l  —  l  1=1  1  =  1 


and  for  i  =  1, . . .  ,m,  is  the  zero  degree  differential  operator  of  multiplication  by  hi.  ao 
is  the  probability  density  of  the  initial  point,  xq. 

Equation  (2)  is  a  stochastic  partial  differential  equation.  In  real  applications,  we  are 
interested  in  constructing  robust  state  estimators  from  observed  sample  paths  with  some 
property  of  robustness.  Davis  studied  this  problem  and  proposed  some  robust  algorithms. 
In  our  case,  his  basic  idea  reduces  to  refining  a  new  unnormalized  density 


u{t,  x)  =  exp 


-'^hi{x)yi{t) 


i=l 


a{t.x). 


It  is  easy  to  show  that  v<  t,  x)  satisfies  the  following  time  varying  partial  differential  equation 

du  Tn 

-^(t,x)  =  Lou{t,x)  +  Y^yi{t)[Lo,  Li]u{t. x)  (3) 

^  m 
iJ—1 

li(0,x)=(To 

where  [Lo,Li]  denotes  the  Lie  bracket  of  Lq  and  Li. 
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Definition.  The  estimation  algebra  of  a  filtering  problem  (1),  is  defined  to  be  the  Lie 
algebra  generated  by  {Lq,  Li,...  ,  Lm)i  ov  E  =  {Lq.  L  1,  .  .  .  ,  Lm) L.A. 

If  in  addition  there  exists  a  potential  function  C  such  that  fi  =  for  all  1  <  v<  n, 
then  the  estimation  algebra  is  called  exact. 

The  estimation  algebra  is  said  to  be  with  maximal  rank  if  Xi  +  Ci  is  in  £■  for  all  1  <  i  <  n 
where  Cj  is  a  constant. 

The  problem  is  to  solve  explicitly  equation  (3)  in  real-time.  In  particular,  we  want  to 
construct  all  possible  finite  dimensional  filters  via  direct  method  or  Wei-Norman  approach. 
This  includes  solving  the  Brockett  problem  on  classification  of  finite  dimensional  estimation 
algebras. 

B.  Summary  of  the  most  important  results. 

(I)  In  [Mi  1],  Mitter  pointed  out  that  the  innovation  approach  to  nonlinear  filtering  theory 
is  not,  in  general,  explicitly  computable.  It  was  first  proposed  by  Brockett  and  Clark 
[Br-Cl],  Brockett  [Br],  and  Mitter  [Mil]  to  use  estimation  algebras  to  construct  finite¬ 
dimensional  filters.  The  idea  is  to  use  the  Lie  algebraic  method  to  solve  the  Duncan- 
Mortensen-Zakai  (DMZ)  equation,  which  is  a  stochastic  partial  differential  equation.  By 
working  on  the  robust  form  of  the  DMZ  equation,  we  can  reduce  the  complexity  of  the 
problem  to  that  of  solving  a  time- variant  partial  differential  equation. 

In  the  past  decade,  the  Lie  algebraic  viewq)oint  has  been  remarkably  successful,  and 
recent  works  T-W-Y],  [D-T-W-Y],  [Ya],  [Ch-Ya],  [Ct-Yal],  [Ch-Ya2],  [C-L-Yl],  [C-L-Y2], 
[Hu-Ya2],  [Hu-Ya3],  [Wo-Ya]  have  given  us  a  deeper  understanding  of  the  DMZ  equation, 
which  was  essential  for  progress  in  nonlinear  filtering  as  well  as  in  stochastic  control.  In 
fact  it  was  Yau  (cf.  [Yal],  [Ya2])  who  first  used  Lie  algebraic  method  to  discover  the  most 
general  class  of  finite  dimensional  filters  which  include  linear  filters  and  exact  filters  as 
special  cases.  In  [Ch],  this  general  class  of  finite  dimensional  filters  are  called  Yau  filters. 

In  spite  of  the  success  of  the  Lie  algebra  method,  it  is  extremely  desirable  to  treat  the 
DMZ  equation  by  a  direct  method. 

Despite  its  usefulness,  the  Kalman-Bucy  filter  is  not  perfect.  One  of  its  weaknesses 
is  that  it  needs  a  Gaussian  assumption  on  the  initial  data.  The  situation  is  more  com¬ 
plex  when  the  statistics  of  the  initial  condition  are  modeled  by  an  arbitrary  distribution. 
In  the  case  where  the  linear  filtering  system  (i.e..  /,  g,  and  h  are  linear  functions  in 
(1)  is  completely  reachable  and  completely  observable,  Hazewinkel  observed  on  p.  115  of 
[Ha]  that  the  estimation  algebra  E  (i.e.,  a  Lie  algebra  generated  by  differential  operators 
Lq,  hi{x), . . .  ,  hm{x))  is  the  2n  -t-  2  dimensional  Lie  algebra  with  basis  Lq,  . . .  , 
xi,.. .  ,Xn,  1.  Even  in  this  case,  the  Wei-Norman  approach  used  to  find  the  solution  of 
(3)  is  more  complicated  than  the  procedure  in  Theorem  1  below  because  not  only  must 
one  solve  a  finite  system  of  ordinary  differential  equation  and  a  Kolmogorov  equation, 
but  also  one  has  to  integrate  n  partial  differential  equations  corresponding  to  the  oper- 
sll’  •  •  •  •  sir-  More  important,  if  the  linear  r/stem  is  not  completely  reachable  or 
completely  observable,  then  the  basis  of  the  estimation  algebra  is  not  explicitly  knowm 
(although  it  can  be  computed).  As  a  result,  there  is  an  additional  disadvantage  of  the 
Wei-Norman  approach,  namely,  one  cannot  vuite  down  the  finite  system  of  ordinary  dif¬ 
ferential  equation  explicitly  in  the  non-maximal  rank  case.  The  novelty  of  theorem  1  is 
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that  our  finite  system  of  ordinary  differential  equations  is  explicitly  written  down  and  our 
procedure  to  get  the  solution  of  (3)  is  simpler  than  the  Lie  algebra  approach.  Most  impor¬ 
tantly.  our  theorem  works  for  Yau  filtering  system  which  includes  linear  filtering  system 
and  exact  filtering  system  as  special  cases. 

Theorem  1.  Consider  the  Yau  filtering  system  (1)  with  arbitrary  initial  condition,  i.e., 

n 

(Yl)  fi{x)  =  ii{x)  +  §f(x),  1  <  i  <  n,  where  ii  -  Y,  for  1  <  i  <  n  and  F  is  a 

j=i 

function. 

n 

(Y2)  hi{x)  =  Y  +  Ci,  1  <  i  <  m. 

n  n  m  n  n 

(Y3)  r]{x)  :=  Y  fii^)  +  Y  +  Y  hUx)  =  Y  VijXiXj  +  Y  +  Vo,  where  r)ij.  r\i  and 

i=l  2=1  2=1  i.j=l  i=l 

are  constants. 

Choose  a  function  G{x)  such  that 


AG{x)  +  IVGi^M  +2£«,(x)^(x)  =  ,(x)  -  -  E|§:W. 


1=1 


2=1 


2  =  1 


dxi 


Then  the  solution  u{t,  x)  for  the  Duncan- Mortensen-Zakai  equation  (3)  is  reduced  to  the 
solution  u(t,  x)  for  the  Kolmogorov  equation 


^(f,x)  =  iAS(f,x)  -  |:(<.W  +  ^((.x)  -  |:(^(x)  +  0(x))s(t.x) 


where 


„  c(t)+G(x)+E  Oi(<)^i-F(x+6(t)) 

u{t.x)=e  *=1  u{t,x  +  b{x)) 


and  ai{t),  bi(t),  and  c{t)  satisfy  the  following  system  of  ODEs:  For  1  <  i  <  n 


bi(t)  cii{t)  'y  dijbj{t)  -|-  y  — 0 


i=i 


j=i 


n  1  ^ 

W  +  Yl  -  0  +  Vji)bj{t)  =  0 

j=i  ^  j=i 

<:'(*) + 5  E(*';(*))"  -  E  ».(')(>:(()  -  ^  E 

^  2=1  2=1 
-71  71 

~oYl  + Yl 


(4) 

(5) 


kj=\ 


2=1 


2=1 


(6) 
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Theorem  2.  Consider  the  Yau  filtering  system  (1)  with  arbitrary  initial  condition  sat¬ 
isfying  (Yl),  (Y2)  and  (Y3)  in  Theorem  1.  Then  the  solution  u{t,x)  for  the  Duncan- 
Mortensen-Zakai  equation  (3)  is  reduced  to  the  solution  u{t,  x)  for  the  Kolmogorov  equa¬ 
tion 


+ 

where 

ai{t)ti-F{x+b{t)) 

u\t,x)  =  e  •=!  u(t,  X  + 

and  ai(<),  hi{t)  and  c(t)  satisfy  ODEs  (4),  (5)  and  (6). 

Theorem  3.  Consider  the  Yau  filtering  system  (1)  with  arbitrary  initial  condition  sat¬ 
isfying  (Yl),  (Y2)  and  (Y3)  in  Theorem  1.  Then  the  solution  u{t,x)  for  the  Duncan- 
Mortensen-Zakai  equation  (3)  is  reduced  to  the  solution  u{t,x)  for  the  Kolmogorov  equa¬ 
tion 


where 


1  =  1 


dt 


+  ^  (E  “  E  x) 


u{t,  x) 


cffHE  ai(f)xi+F(®)-F(x-t-6(f)) 

=  e  '=1  u{t,x  +  b{t)) 


and  ai{t),  bi{t)  and  c{t)  satisfy"  ODEs  (4),  (5)  and  (6). 

Notice  that  the  explicit  recursive  filter  for  exact  filtering  system  was  previously  derived 
only  for  maximal  rank  case  (i.e..  rank  of  (cij)  is  n),  see  [Be]  for  a  particular  maximal  rank 
case  and  [T-W-Y]  for  general  maximal  rank  case.  Our  result  is  an  important  breakthrough 
for  the  last  20  years  because  our  method  works  for  most  general  filtering  systems  and  we 
no  longer  need  maximal  rank  condition  to  construct  explicit  recursive  filter  and  we  can 
allow  arbitrary  initial  condition.  The  significance  of  our  results  are  that  our  algorithm 
is  universal  for  any  Yau  filtering  system  with  arbitrary  initial  condition  and  that  this 
estimation  problem  have  been  factored  into  two  parts:  (1)  the  off-line  calculation  of  the 
Kolmogorov  type  equation  which  does  not  depend  on  the  observations  and  (2)  the  on-line 
solution  of  a  finite  linear  system  of  ordinary  differential  equations,  which  can  be  realized 
in  real  time. 


(II)  Although  the  concept  of  estimation  algebra  has  proven  to  be  an  invaluable  tool  in 
the  study  of  nonlinear  filtering  problems  [Ma] ,  until  recently  very  little  was  known  about 
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estimation  algebras.  Beginning  in  the  late  1980s,  however,  the  structure  and  classification 
of  finite-dimensional  exact  estimation  algebras  were  studied  in  detail  [T-W-Y]  [D-T-W- 
Y].  In  [Wo],  the  concept  of  Q  was  introduced,  which  is  defined  as  the  matrix  whose  (i,j) 
element  is  ^  —  |^,  where  /  is  the  drift  term  of  the  state  evolution  equation.  For  the 
class  of  exact  filtering  systems,  D,  is  identically  zero.  More  recently,  Yau  [Yal],  [Ya2]  has 
studied  filtering  systems  such  that  all  entries  of  fi  are  constants.  He  was  able  to  classify  all 
finite-dimensional  estimation  algebras  of  maximal  rank  in  such  filtering  systems.  Chiou- 
Yau  [Ch-Ya]  and  Chen- Leung- Yau  [C-L-Yl],  [C-L-Ya2]  have  shoum  respectively  that  if  the 
dimension  of  the  state  space  is  two  or  three  or  four,  all  entries  of  Q  are  constants  as  long  as 
the  estimate  algebra  is  of  maximal  rank  and  finite  dimensional.  Thus,  finite-dimensional 
estimation  algebra  of  maximal  rank  is  completely  classified  if  the  dimension  of  state  space 
is  at  most  three.  The  novelty  of  their  theorems  is  that  there  are  no  a  priori  assumptions 
on  the  drift  term  of  the  nonlinear  filtering  system. 

Our  approach  for  the  complete  classification  of  finite-dimensional  estimation  algebras  of 
maximal  rank  consists  of  two  steps.  The  first  step  is  to  prove  that  for  such  an  estimation 
algebra,  all  the  entries  in  the  fl- matrix  are  degree  one  polynomials.  The  second  step  is  to 
prove  that  in  fact  all  the  entries  in  Q,  are  constants.  Then  we  can  apply  the  result  of  Yau 
[Ya]  to  give  a  complete  classification  of  finite-dimensional  estimation  algebras  of  maximal 
rank.  Recently  we  have  completed  the  first  step  (cf.  [Ch-Yal]).  The  following  theorem  is 
due  to  Hu  and  Yau  [Hu-Ya2]. 

Theorem  3.  If  £■  is  a  finite-dimensional  estimation  algebra  of  maximal  rank,  then  all  the 
entries  Uij  =  ^  ^  of  Q  are  degree  one  polynomials.  Let  k  be  the  maximal  rank  of 

quadratic  forms  in  E.  Then  uJij  are  constants  for  I  <  i,  j  <  k  and  k  +  1  <  i,  j  <  n-  ujij 
are  degree  one  polynomials  in  Xi, . . .  ,Xk  for  1  <  i  <  k  or  1  <  j  <  k. 

Let  n  be  the  dimension  of  the  state  space.  In  case  n  =  3,  there  are  three  unknowns: 
and  UJ23.  It  is  easy  to  see  that  they  are  all  degree  tw^o  polynomials  in  view  of 
Ocone’s  theorem.  In  [Ya-Le],  Leung  and  Yau  showed  that  the  coefficients  of  the  quadratic 
parts  of  u;i2,  u;i3,  and  u;23  have  to  satisfy  90  quadratic  equations.  It  was  also  shown  in 
that  paper  that  this  system  of  90  quadratic  equations  has  only  a  trivial  solution.  Later 
Chen,  Leung,  and  Yau  proved  that  Q  is  a  matrix  of  constants  [C-L-Yl].  The  novelty  of 
our  main  theorem  is  that  it  holds  for  arbitrary  n.  Thus,  it  is  the  fundamental  step  in  the 
classification  of  finite-dimensional  estimation  algebras  of  maiximal  rank. 
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